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1. Four Working Analog VLSI Vision Chips 

(a) Time-Derivative Retina (Delbriick h Mead) 

(b) Zero-Crossing Chip (Bair & Koch) 

(c) Resistive Fuse (Harris h Koch) 

(d) Figure- Ground Chip (Luo, Koch h Mathur) 

2. Work in Progress 

3. Conceptual and Practical Lessons Learned 
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Silicon Retina that Computes a Pure Temporal Derivative 

T. Delbriick and C. Mead, 1991 

• Array of 68 by 43 adaptive, high-gain, logarithmic 
photoreceptors, implemented in analog CMOS. 

• No spatial interactions. 

• Array has low offsets and consumes about 4 mW 
power. 

• Array has very small fill-factor (< 3%). 
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1-D Chip that Computes Edges 

W. Bair and C. Koch, 1991 

• 64 pixel, logarithmic photoreceptors in analog CMOS. 

• Each resistive grid implements low-pass filter G (lo) = 
j+jjz- where A is given by the resistances. 

• Chip computes thresholded zero-crossing between two 
resistive networks (implementing a band-pass filter). 

• Output is 63 bit word, indicating presence of edge 
between adjacent pixels. 
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Smoothing 2-D Data in the Presence of Discontinuities 

J. Harris, C. Koch and J. Luo, 1990 

• Algorithmic justification: If values of some variable 
(for example, depth, hue, intensity) between two ad- 
jacent pixels is similar, then smooth away the differ- 
ence (since it is most likely caused by unavoidable 
image noise). If the difference is above a threshold, 
then preserve it, since it is most likely caused by a 
discontinuity between the two locations. 

• These constraints can be implemented within a single 
two- terminal device, the resistive fuse. 

• Device has nonlinear I-V relationship, similar to an 
electrical fuse. 

• Deterministic annealing can be carried out by dy- 
namically adjusting the I-V relationship. 

• Performance of a 20 by 20 pixel analog CMOS chip 
is shown. 
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Segregating a “Figure” from “Ground” 

J. Luo, C. Koch and B. Mathur 1992 

• 48 by 48 pixel resistive grid with configurable switches 
in analog CMOS. 

• Off-chip circuitry detects— possibly incomplete — edges 
and sets switches appropriately. 

• Voltage inside one (or more) figures clearly demar- 
cates them from surrounding pixels. 

• Resistive network has natural boundary completion 
property. 
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Work in Progress: Computing Motion 

• Differential methods to compute velocity (e.g. v = 
—I t /I x ) are numerically ill-conditioned and require 
very accurate components. 

• Correlation methods to estimate velocity (e.g. I(x,t)x 
I(x - (- Ax, t + At)) are robust but expensive in VLSI. 

• Computing velocity in the temporal pulse domain 
appears very promising (Sarpeshkar, Bair and Koch, 
1993). 

• Special-purpose analog motion sensors can be built 
for estimating time- to- contact, observer head- 
ing, discontinuities in the optical flow and 

other qualitative features of the optical flow field. 

• Exploiting Green’s theorem 

j A V • V(x, y)dxdy = f c V • n ds 

to compute r (time-to-collision) in a very robust man- 
ner (using a single sensor). 
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Work in Progress: Neuromorphic Systems 

• Carver Mead emphasizes analog VLSI as a medium 
to model and understand the nervous system (syn- 
thetic neurobiology). 

• Mahowald and Douglas (1991) have successfully built 
pyramidal cells in analog CMOS, including den- 
dritic trees, EPSPs and IPSPs and nonlinear mem- 
brane conductances. 

• Koch, Douglas, Sejnowski and Lisberger are involved 
in long-term project to build a complete oculo- motor 
system (including two retinae on movable platform, 
superior colliculus, brain stem nucleus for eye plant, 
and cortical areas) based upon the visual system of 
primates. 
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What Lessons Have We Learned 

• Conception, design and fabrication of smart vision 
chips must go hand-in-hand with the design of the 
appropriate vision algorithms. 

• It is crucial to understand what types of computa- 
tions map naturally onto analog hardware and which 
ones are better suited to Turing universal digital 
machines (e.g. motion analysis). 

• Important to integrate adaptation and learning abili- 
ties at all levels of the circuitry (from photoreceptors 
to output). 
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What Should We Do 

• Principal limitation of today’s circuits is not small 
array size (< 100 x 100 pixels) but lack of further 
on-chip processing power. 

• Do not emphasize development of very costly basic 
fabrication and circuit technology at the expense of 
inexpensive algorithmic development and implemen- 
tation. 

• Development of interchip communication protocols 
(e.g. Mahowald and Mead’s event-driven address- 
ing scheme). 

• Design not just smart add-on’s, but complete, au- 
tonomous systems. 
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